Information processing apparatus, information processing method, and program

ABSTRACT

There is provided an information processing apparatus including an action recognition unit configured to recognize an action state of a user based on a measurement result obtained by a sensor carried by the user, and a photographing control unit configured to control timing at which a photographing unit carried by the user is allowed to perform photographing based on the recognized action state of the user.

CROSS REFERENCE TO RELATED APPLICATIONS

This application claims the benefit of Japanese Priority PatentApplication JP 2013-228073 filed Nov. 1, 2013, the entire contents ofwhich are incorporated herein by reference.

BACKGROUND

The present disclosure relates to an information processing apparatus,an information processing method, and a program.

In recent years, various types of devices, such as digital cameras andsmartphones, which are equipped with various sensors includinggyroscopes as well as image sensors have been developed. As an example,JP 4289326B discloses a technology that recognizes an action of a userholding a camcorder based on sensor data obtained by a sensor that isbuilt in the camcorder in the same timing as that of photographing bythe camcorder, and records the recognized result of action inassociation with the photographed image.

SUMMARY

However, the above-mentioned technology is intended to perform ameasurement related to an action of a user at the timing ofphotographing. Thus, with the above-mentioned technology, it may not bepossible to control adaptively the timing of photographing depending onan action state of the user. For example, with the above-mentionedtechnology, the timing of photographing may not be changed automaticallybetween a state in which the user is moving and a state in which theuser is stationary, and thus many images that the user does not want tophotograph may be more likely to be captured. Therefore, according to anembodiment of the present disclosure, there is provided a novel andimproved information processing apparatus, information processingmethod, and program, capable of controlling adaptively the timing ofphotographing depending on an action state of the user.

According to an embodiment of the present disclosure, there is providedan information processing apparatus including an action recognition unitconfigured to recognize an action state of a user based on a measurementresult obtained by a sensor carried by the user, and a photographingcontrol unit configured to control timing at which a photographing unitcarried by the user is allowed to perform photographing based on therecognized action state of the user.

According to another embodiment of the present disclosure, there isprovided an information processing method including recognizing anaction state of a user based on a measurement result obtained by asensor carried by the user, and controlling, by a processor, timing atwhich a photographing unit carried by the user is allowed to performphotographing based on the recognized action state of the user.

According to another embodiment of the present disclosure, there isprovided a program for causing a computer to function as an actionrecognition unit configured to recognize an action state of a user basedon a measurement result obtained by a sensor carried by the user, and aphotographing control unit configured to control timing at which aphotographing unit carried by the user is allowed to performphotographing based on the recognized action state of the user.

According to one or more of embodiments of the present disclosuredescribed above, it is possible to control adaptively the timing ofphotographing depending on the action state of the user. Note that theadvantages described here are not necessarily limited, or any otheradvantages described herein and other advantages understood from thepresent disclosure may be achievable.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a diagram for describing the basic configuration of aninformation processing system that is common to each embodiment of thepresent disclosure;

FIG. 2 is a diagram for describing the hardware configuration of aninformation processing apparatus 10 according to each embodiment of thepresent disclosure;

FIG. 3 is a functional block diagram illustrating the configuration ofthe information processing apparatus 10 according to a first embodimentof the present disclosure;

FIG. 4 is a diagram for describing an example of the action recognitionby an action recognition unit 102 according to the first embodiment;

FIG. 5 is a diagram for describing an example of the action recognitionby the action recognition unit 102 according to the first embodiment;

FIG. 6 is a diagram for describing an example of the action recognitionby the action recognition unit 102 according to the first embodiment;

FIG. 7 is a diagram for describing an example of the action recognitionby the action recognition unit 102 according to the first embodiment;

FIG. 8 is a diagram for describing an example of the photographingcontrol by a photographing control unit 104 according to the firstembodiment;

FIG. 9 is a diagram for describing an example of the photographingcontrol by the photographing control unit 104 according to the firstembodiment;

FIG. 10 is a diagram for describing an example of the display control bya display control unit 108 according to the first embodiment;

FIG. 11 is a sequence diagram illustrating the operation according tothe first embodiment;

FIG. 12 is a functional block diagram illustrating the configuration ofthe information processing apparatus 10 according to a second embodimentof the present disclosure;

FIG. 13 is a diagram for describing an example of the image processingby an image processing unit 110 according to the second embodiment;

FIG. 14 is a diagram for describing an example of the image processingby the image processing unit 110 according to the second embodiment;

FIG. 15 is a diagram for describing a state in which a user looksforward and then is stationary;

FIG. 16 is a diagram for describing a state in which a user is walkingwhile looking forward;

FIG. 17 is a diagram for describing an example of image processing bythe image processing unit 110 according to the second embodiment;

FIG. 18 is a diagram for describing an example of image processing bythe image processing unit 110 according to the second embodiment;

FIG. 19 is a diagram for describing a state in which a user looks downand then is stationary;

FIG. 20 is a diagram for describing an example of image processing bythe image processing unit 110 according to the second embodiment;

FIG. 21 is a diagram for describing an example of image processing bythe image processing unit 110 according to the second embodiment;

FIG. 22 is a diagram for describing an example of image processing bythe image processing unit 110 according to the second embodiment;

FIG. 23 is a diagram for describing an example of image processing bythe image processing unit 110 according to the second embodiment; and

FIG. 24 is a sequence diagram illustrating operation according to thesecond embodiment.

DETAILED DESCRIPTION OF THE EMBODIMENT(S)

Hereinafter, preferred embodiments of the present disclosure will bedescribed in detail with reference to the appended drawings. Note that,in this specification and the appended drawings, structural elementsthat have substantially the same function and structure are denoted withthe same reference numerals, and repeated explanation of thesestructural elements is omitted.

The “embodiments for implementing the present disclosure” will bedescribed in the following order of items.

1. Background

2. Basic Configuration of Information Processing System

3. Detailed Description of each Embodiment

-   -   3-1. First Embodiment    -   3-2. Second Embodiment

4. Modification

<<1. Background>>

The present disclosure may be implemented in various embodiments, asdescribed in detail in the items “3-1. First Embodiment” and “3-2.Second Embodiment” and their subcategories, as an example. To clearlyillustrate features of embodiments of the present disclosure, thetechnical background that led to the conception of an informationprocessing apparatus according to an embodiment of the presentdisclosure is first described.

The development of wearable devices, which have a built-in image sensorand are used by being mounted constantly on the user, has been recentlystudied. Such a wearable device is likely to be able to recognizeconstantly an object, a person, or the like contained in an imagecaptured by a camera attached thereto and provide the user withinformation related to an object, a person, or the like, for example,viewed by the user based on recognition results.

However, there remains a problem as described below in providing suchservice. First, when a wearable device is configured as abattery-powered mobile device, it is necessary to reduce its weightbecause the user wears the device on his or her body. Thus, there is aproblem with restrictions on the capacity of a battery provided in thewearable device. Accordingly, the time available for the user to usecontinuously the device is limited.

Second, because of the nature of the device worn by the user, blurringoccurs with the movement of a photographer depending on the timing ofphotographing. Thus, if a service of allowing a camera to becontinuously running and to perform automatic photographing is assumed,improper environment recognition is performed due to blurring containedin a photographed image and thus an erroneous recognition or delay inprocessing may be occurred. In addition, when recognition is necessaryto be performed in a very short time such as when a subject is moving,it is more likely to result in failed recognition.

Third, in general, when environment recognition is performed based onthe output of an image sensor, for example, if an object is specified,or a photographing location or a posture of the photographer isspecified, an additional large amount of data for reference isnecessary. Such data for reference is difficult to store in a wearabledevice, and thus a method of sending a photographed image to a serverthat stores the data for reference and of causing the server to performimage recognition may be considered. However, the transmission of alarge amount of data, such as data of moving images captured for a longtime, to a server is considered to be impractical in view ofcommunication speed, battery performance, or the like in the currentmobile communication environment.

Thus, in view of the foregoing situation, the information processingapparatus 10 according to an embodiment of the present disclosure hasbeen conceived. The information processing apparatus 10 is capable ofcontrolling adaptively the timing of photographing depending on theaction state of the user. In addition, the information processingapparatus 10, when transmitting a photographed image to a server 20, canreduce adaptively communication traffic.

<<2. Basic Configuration of Information Processing System>>

The basic configuration of an information processing system that iscommon to each embodiment is described below with reference to FIG. 1.As illustrated in FIG. 1, the information processing system according toeach embodiment includes the information processing apparatus 10, acommunication network 12, and the server 20.

<2-1. Information Processing Apparatus 10>

The information processing apparatus 10 is an example of the informationprocessing apparatus according to an embodiment of the presentdisclosure. The information processing apparatus 10 is, for example, adevice provided with a glasses-type display, as illustrated in FIG. 1.In addition, a translucent see-through type display can be employed asthe glasses-type display. This see-through type display enables the userto view the outside environment through the display.

The information processing apparatus 10 is used by being worn on theuser's head. In addition, as illustrated in FIG. 1, the informationprocessing apparatus 10 has a camera 166, which will be described later,at a position in the periphery of the display. The user can photograph alandscape at which the user is looking with the camera 166 while movingby wearing the information processing apparatus 10.

[2-1-1. Hardware Configuration]

The information processing apparatus 10 may have such hardwareconfiguration as illustrated in FIG. 2. As illustrated in FIG. 2, theinformation processing apparatus 10 is configured to include a centralprocessing unit (CPU) 150, a read only memory (ROM) 152, a random accessmemory (RAM) 154, an internal bus 156, an interface 158, an outputdevice 160, a storage device 162, a communication device 164, a camera166, a position information measuring device 168, an acceleration sensor170, a gyroscope 172, and a microphone 174.

(CPU 150)

The CPU 150 is composed of a various types of processing circuits andserves as a controller 100 for controlling the entire informationprocessing apparatus 10. In addition, in the information processingapparatus 10, the CPU 150 implements each function of an actionrecognition unit 102, a photographing control unit 104, a transmissioncontrol unit 106, a display control unit 108, an image processing unit110, a face region detection unit 112, and a blur determination unit114, which are described later.

(ROM 152)

The ROM 152 stores a program used by the CPU 150 and it also stores datafor control of operation parameters or the like to be used by the CPU150.

(RAM 154)

The RAM 154 stores temporarily a program, for example, to be executed bythe CPU 150.

(Interface 158)

The interface 158 connects the output device 160, the storage device162, the communication device 164, the camera 166, the positioninformation measuring device 168, and acceleration sensor 170, thegyroscope 172, and the microphone 174 with the internal bus 156. Forexample, the output device 160 exchanges data with the CPU 150 and othercomponents via the interface 158 and the internal bus 156.

(Output Device 160)

The output device 160 includes a display device such as a liquid crystaldisplay (LCD), an organic light emitting diode (OLED), and a lamp. Thisdisplay device displays an image captured by the camera 166, an imagegenerated by the CPU 150, or the like. Furthermore, the output device160 includes an audio output device such as a loudspeaker. This audiooutput device converts audio data or the like into sound and outputs it.

(Storage Device 162)

The storage device 162 is a device for storing data, which is used tostore a program or various data to be executed by the CPU 150. Thestorage device 162 includes a storage medium, a recording device forrecording data in a storage medium, a reading device for reading outdata from a storage medium, a deletion device for deleting data recordedin a storage medium, or the like.

(Communication Device 164)

The communication device 164 is a communication interface that iscomposed of a communication device or the like used to connect to acommunication network such as a public network or the Internet. Inaddition, the communication device 164 may be a wireless LAN compatiblecommunication device, a long-term evolution (LTE) compatiblecommunication device, or a wired communication device that performscommunication through a wired line. The communication device 164 serves,for example, as a communication unit 120 that will be described later.

(Camera 166)

The camera 166 has functions of forming an image obtained from theoutside through a lens on an image sensor, such as a charge-coupleddevice (CCD) or a complementary metal-oxide semiconductor (CMOS), and ofphotographing still or moving images.

(Position Information Measuring Device 168)

The position information measuring device 168 receives a positioningsignal from a positioning satellite, such as the global positioningsystem or a global navigation satellite system (GLONASS), and thusmeasures its current position. In addition, the position informationmeasuring device 168 may have functions of receiving Wi-Fi (registeredtrademark) radio waves from a plurality of base stations and measuringits current position based on the reception intensity of the receivedWi-Fi radio waves and the positions of each base station. In addition,the position information measuring device 168 may have a function ofmeasuring its current position based on communications with a Bluetoothaccess point. The position information measuring device 168 serves as ameasurement unit 122 that will be described later.

(Acceleration Sensor 170)

The acceleration sensor 170 measures the acceleration of the informationprocessing apparatus 10. The acceleration sensor 170 serves as themeasurement unit 122.

(Gyroscope 172)

The gyroscope 172 measures the angle or the angular velocity of theinformation processing apparatus 10. For example, the gyroscope 172detects the inertial force or the Coriolis force applied to theinformation processing apparatus 10 and thus measures the angularvelocity of the information processing apparatus 10. The gyroscope 172serves as the measurement unit 122.

(Microphone 174)

The microphone 174 collects sound coming from outside. The microphone174 serves as the measurement unit 122. The hardware configuration ofthe information processing apparatus 10 is not limited to theabove-described configuration. For example, the information processingapparatus 10 may be configured without any one or more of the storagedevice 162, the position information measuring device 168, theacceleration sensor 170, the gyroscope 172, and the microphone 174.

<2-2. Communication Network 12>

The communication network 12 is a wired or wireless communicationchannel for information transmitted from a device connected to thecommunication network 12. For example, the communication network 12 mayinclude public networks such as the Internet, telephone network, andsatellite communication network, various local area networks (LANs)including Ethernet (registered trademark), and wide area networks(WANs). In addition, the communication network 12 may include a leasedline network such as Internet protocol virtual private network (IP-VPN).

<2-3. Server 20>

The server 20 is an exemplary image processing apparatus according to anembodiment of the present disclosure. The server 20 has a function ofperforming image recognition on a photographed image. In addition, theserver 20 includes a storage unit (not illustrated) for storing aplurality of data for reference that include various types ofinformation in the real world.

The server 20, for example when receiving a photographed image from theinformation processing apparatus 10, performs image recognition on thephotographed image, and so can recognize an object, a person, or thelike contained in the photographed image. The server 20 can extractadditional information that is information related to the recognizedobject, person, or the like from the plurality of data for referencestored in the storage unit, and can transmit the extracted additionalinformation to the information processing apparatus 10.

Such a function of the server 20 makes it possible for the user carryingthe information processing apparatus 10 to obtain a notification ofdetailed information related to buildings, goods, persons, or the likeviewed by the user while moving around in the real world from the server20. In addition, the user can know the reception of additionalinformation from the server 20 through a change in video, audio, orvibration outputted from the output device 160 of the informationprocessing apparatus 10. For example, the output device 160 superimposesthe additional information on a display screen or changes the mode ofvibration, thereby informing the user of the contents of information orthe location direction.

3. Detailed Description of Embodiments

The basic configuration of the information processing system accordingto each embodiment has been described above. Subsequently, eachembodiment is described in detail.

3-1. First Embodiment

[3-1-1. Configuration of Information Processing Apparatus 10]

The configuration of the information processing apparatus 10 accordingto the first embodiment is described in detail. FIG. 3 is a functionalblock diagram illustrating the configuration of the informationprocessing apparatus 10 according to the first embodiment. Asillustrated in FIG. 3, the information processing apparatus 10 isconfigured to include a controller 100, a communication unit 120, ameasurement unit 122, a photographing unit 124, and a display unit 126.

(3-1-1-1. Controller 100)

The controller 100 controls the overall operation of the informationprocessing apparatus 10 using hardware, such as the CPU 150 and RAM 154,which is built in the information processing apparatus 10. In addition,as illustrated in FIG. 3, the controller 100 is configured to include anaction recognition unit 102, a photographing control unit 104, atransmission control unit 106, and a display control unit 108.

(3-1-1-2. Action Recognition Unit 102)

The action recognition unit 102 recognizes an action state of the userbased on the results of measurement by the measurement unit 122 thatwill be described later. The measurement unit 122 is an example of thesensor according to an embodiment of the present disclosure. The actionstate includes, for example, a movement state of the user, avision-related state of the user, and a voice-related state of the user.The detailed processing of each state is described below.

RECOGNITION EXAMPLE 1 (Recognition of Movement State)

For example, the action recognition unit 102 is able to recognize amovement state of the user based on the results of measurement by themeasurement unit 122. The movement state indicates states in which auser is walking, running, riding a bicycle, and riding in a vehicle suchas automobiles, trains, and planes, or a state in which a user isstationary such as when the user is sitting in a chair.

Referring to FIG. 4, a description of how it functions is given in moredetail. FIG. 4 is a graph showing values obtained by measurement of theacceleration sensor 170 in association with measurement time. As shownin FIG. 4, the changes in acceleration having a substantially similarwaveform are measured in time zones of time t1 to t2, time t2 to t3, andtime t3 to t4. The change in acceleration having such a waveformapproximates the change in acceleration when a person is walking. Thus,the action recognition unit 102 recognizes that the user is in walkingstate in the time zone from time t1 to t4, based on the measurementresults obtained by the acceleration sensor 170, which are shown in FIG.4.

RECOGNITION EXAMPLE 2 (Recognition of Vision-Related State)

Furthermore, as recognition example 2, the action recognition unit 102can recognize a vision-related state of the user based on themeasurement results obtained by the measurement unit 122. Thevision-related state indicates in what state and under whatcircumstances the user looks at an object. For example, thevision-related state indicates a state in which the user is watching aparticular object or person, a state in which the user is lookingaround, or the direction in which the user is looking, such as the frontor a vertical or horizontal direction. More specifically, the actionrecognition unit 102 can recognize the user's vision-related state basedon the movement of the user's head that is measured by the gyroscope172. For example, when the gyroscope 172 measures that the speed ofmovement of the user's head is reduced to less than or equal to apredetermined value, the action recognition unit 102 recognizes that theuser is watching.

Referring to FIG. 5 or 6, a description of how it functions is given inmore detail. FIG. 5 is an example of the graph showing measurementvalues obtained by the acceleration sensor 170 in association withmeasurement time. In the graph shown FIG. 5, the accelerationfluctuations in the time zone from time t1 to t2 are large, and aftertime t2, the fluctuation amount is significantly reduced and thusmeasured values of the acceleration are at or close to zero. Thefluctuations in acceleration having the waveform as shown in FIG. 5approximate the fluctuations in acceleration of the head when a personfinds something and watches it at approximately time t2.

In addition, FIG. 6 is an example of the graph showing measurementvalues of the angle of the user's head obtained by the gyroscope 172 inassociation with measurement time. In the graph shown in FIG. 6, theangular fluctuations in the time zone from time t1 to t2 are large, andafter time t2, the amount of fluctuations is significantly reduced andthus measured values of the angle are at a substantially fixed value.The acceleration fluctuations having the waveform as shown in FIG. 6approximate the acceleration fluctuations of the head when the usermoves his head and then stops its motion, such as when a person findssomething and watches it at approximately time t2.

Thus, the action recognition unit 102 recognizes that the user iswatching after the time t2, based on the measurement results obtained bythe acceleration sensor 170 as shown in FIG. 5 and/or the measurementresults obtained by the gyroscope 172 as shown in FIG. 6. The actionrecognition unit 102 also can recognize the action of the user movinghis head and then stopping the motion based on the change in magnitudeof the sound of blowing wind that is detected by the microphone 174instead of the gyroscope 172.

In addition, FIG. 7 is another example of the graph showing the valuesobtained by measuring the angle of the user's head in association withthe measurement time. In the graph shown in FIG. 7, the angles fluctuategradually between the angles θ1 and θ2 over the whole measurementperiod. The fluctuations in angle of the waveform as shown in FIG. 7approximate the fluctuations in acceleration of a person's head, forexample, when the person is looking around, wandering, or looking down.Thus, the action recognition unit 102 recognizes that, for example, theuser is looking around over the whole measurement period based on themeasurement results obtained by the acceleration sensor 170 as shown inFIG. 7.

RECOGNITION EXAMPLE 3 (Recognition of Voice-Related State)

In addition, as recognition example 3, the action recognition unit 102can recognize a voice-related state of the user based on the measurementresults obtained by the measurement unit 122. The voice-related stateindicates, for example, a state in which a user is talking with otherpeople, a state in which a user is silent, or the degree of magnitude ofthe voice produced by a user. For example, the action recognition unit102 recognizes that a user is talking with other people based on themeasurement results obtained by the microphone 174.

(3-1-1-3. Photographing Control Unit 104)

The photographing control unit 104 controls the timing at which aphotographing unit 124 described later is allowed to performphotographing based on the action state of the user recognized by theaction recognition unit 102. The following description herein is givenbased on an example in which the photographing control unit 104 allowsthe photographing unit 124 to capture still images. As its technicalbackground, an embodiment of the present disclosure may be intended toreduce the power consumption as much as possible, but it is not limitedto such an example. The photographing control unit 104 may allow thephotographing unit 124 to capture moving images.

CONTROL EXAMPLE 1 (Control Based on Movement State)

More specifically, the photographing control unit 104 can change thetiming at which the photographing unit 124 is allowed to performphotographing based on whether a user is moving or not. For example, thephotographing control unit 104 sets a frequency with which thephotographing unit 124 is allowed to perform photographing when the useris stationary to be smaller than a frequency to be set when the user ismoving. In general, when a user is stationary, it is assumed that thelandscape viewed by user has a little change. Thus, with control example1, an image in which it is assumed that the image is undesirable to theuser or the image is not considered important can be prevented frombeing captured.

Furthermore, the photographing control unit 104 allows the photographingunit 124 to perform photographing at predetermined time intervals when auser continues to move. Referring to FIG. 9, a description of how itfunctions is given in more detail. FIG. 9 is an example of the graphshowing the measurement results obtained by the acceleration sensor 170in association with measurement time. In FIG. 9, there are illustratedthe results in which the acceleration fluctuations in the time zonesfrom time t1 to t7 that are similar to the acceleration fluctuations inthe time zone from time t1 to t2 shown in FIG. 4 are continuouslymeasured. In addition, in FIG. 9, the duration between time tb and tc isassumed to be the same as the duration between time ta and tb.

In the time zones from time t1 to t7 shown in FIG. 9, the actionrecognition unit 102 recognizes that a user is in walking state. Thus,the photographing control unit 104 allows the photographing unit 124 toperform photographing at the time interval between times ta and tb sothat photographing is performed, for example, at time ta, tb, and tc inFIG. 9. In general, when a user is walking or is riding a train, thesurrounding landscape viewed through the eyes of the user changesgenerally from moment to moment. Thus, according to control example 1,it is possible to photograph a sequence of images by capturing thechange in landscapes with the movement of the user even withoutcapturing moving images. Accordingly, the number of photographing timesby the photographing unit 124 can be decreased, thereby reducing thepower consumption.

CONTROL EXAMPLE 2 (Control Based on Vision-Related State)

In addition, as control example 2, the photographing control unit 104can change the timing at which the photographing unit 124 is allowed toperform photographing based on the vision-related state of a user thatis recognized by the action recognition unit 102. For example, when theaction recognition unit 102 recognizes that a user is watching asimmediately after time t2 shown in FIG. 5 or 6, the photographingcontrol unit 104 allows the photographing unit 124 to performphotographing. According to control example 2, when a user is watching,for example, goods displayed in a department store, a building orstructure in a tour place, or a person who a user saw on the street, itis possible to photograph the object that is being watched by the userin reliable and immediate manner.

As a modification, when an action in which a user moves his head or neckis recognized, it is estimated that the user is watching, and thus thephotographing control unit 104 may allow the photographing unit 124 toperform photographing in a continuous way in accordance with themovement of the user's head or neck. According to this modification,there is an advantage that a change in how the user watched duringphotographing can be recorded.

CONTROL EXAMPLE 3 (Control Based on Voice-Related State)

In addition, as control example 3, the photographing control unit 104 isable to allow the photographing unit 124 to perform photographing whenthe action recognition unit 102 recognizes that a user has spoken.According to this control example 3, when a user is talking with otherpeople, it is possible for the user to photograph the conversationpartner automatically, for example, without having to release theshutter.

(3-1-1-4. Transmission Control Unit 106)

The transmission control unit 106 allows the photographing unit 120 totransmit, for example, an image photographed by the photographing unit124 to the server 20.

(3-1-1-5. Display Control Unit 108)

The display control unit 108 allows the display unit 126, which will bedescribed later, to display, for example, various character strings orimages such as additional information received from the server 20.Referring to FIG. 10, a description of how it functions is given in moredetail. FIG. 10 is a diagram for describing a display example in whichadditional information received from the server 20 is displayed on thedisplay unit 126. The left side view of FIG. 10 is an example of aphotographed image (a photographed image 30) captured by thephotographing unit 124. In addition, the right side view of FIG. 10 isan example (a picture 40) in which the photographed image 30 istransmitted to the server 20 and then additional information receivedfrom the server 20 is displayed on the display unit 126. FIG. 10illustrates an example in which the information processing apparatus 10receives, from the server 20, additional information about theadvertisement of “ON SALE (October 1-October 31)” for a department store300 contained in the photographed image 30 or addition informationindicating a station name of “STATION X ON LINE A” for a station 302.

As illustrated in the right side view of FIG. 10, the display controlunit 108 superimposes a display that indicates additional informationreceived from the server 20 on the picture 40. For example, when thedisplay unit 126 is composed of a see-through type display, the picture40 is a landscape at which the user is actually looking through thedisplay. Alternatively, the display control unit 108 may display animage, which is the same as the photographed image 30, as the picture40.

(3-1-1-6. Communication Unit 120)

The communication unit 120 transmits and receives information to andfrom various types of devices connected to the communication network 12,for example, by wireless communication. For example, the communicationunit 120 transmits the image photographed by the photographing unit 124to the server 20 under the control of the transmission control unit 106.In addition, the communication unit 120 receives the above-describedadditional information from the server 20.

(3-1-1-7. Measurement Unit 122)

The measurement unit 122 is composed, for example, of the positioninformation measuring device 168, the acceleration sensor 170, thegyroscope 172, and the microphone 174. The measurement unit 122 measuresacceleration of the information processing apparatus 10, an angle of theinformation processing apparatus 10, or the sound coming from outside.In the first embodiment, the measurement unit 122 is basically assumedto perform continuous measurement. The reason for this is, for example,because various sensors such as the acceleration sensor 170 arecontinuously activated but their power continuously consumed issubstantially smaller than the power consumed by photographing of thecamera 166.

(3-1-1-8. Photographing Unit 124)

The photographing unit 124 photographs an outside still or moving imageunder the control of the photographing control unit 104. In addition,the photographing unit 124 can also photograph an outside sill or movingimage, for example, in accordance with an instruction from the user toan input device (not illustrated) such as a button attached to theinformation processing apparatus 10. The following description herein isgiven based on an example in which the photographing unit 124photographs an image under the control of the photographing control unit104.

(3-1-1-9. Display Unit 126)

The display unit 126 displays, for example, various character strings orimages such as additional information received from the server 20 underthe control of the display control unit 108. The configuration of theinformation processing apparatus 10 according to the first embodiment isnot limited to the above-described configuration. For example, themeasurement unit 122 may not be included in the information processingapparatus 10 but may be included in other devices.

[3-1-2. Operation]

The configuration according to the first embodiment has been describedabove. Next, the operation according to the first embodiment isdescribed. FIG. 11 is a sequence diagram illustrating the operationaccording to the first embodiment. As illustrated in FIG. 11, themeasurement unit 122 of the information processing apparatus 10measures, for example, acceleration of the information processingapparatus 10, an angle of the information processing apparatus 10, orthe sound coming from outside (S101). Subsequently, the actionrecognition unit 102 recognizes an action state of the user based on themeasurement results measured in step S101 (S102).

Subsequently, the photographing control unit 104 determines whether thepresent is the timing at which the photographing unit 124 is allowed toperform photographing based on the action state of the user that isrecognized in step S012 (S103). If it is not determined that the presentis the timing at which the photographing unit 124 is allowed to performphotographing (S103: NO), then the information processing apparatus 10performs the operation of S101 again.

On the other hand, if it is determined that the present is the timing atwhich the photographing unit 124 is allowed to perform photographing(S103: YES), then the photographing control unit 104 adjusts varioustypes of parameters such as photographic sensitivity or shutter speed toan appropriate value, for example, based on information includingbrightness of a surrounding environment (S104). Then, the photographingcontrol unit 104 allows the photographing unit 124 to performphotographing (S105).

Subsequently, the transmission control unit 106 determines whether theimage photographed in step S105 is transmitted to the server 20, forexample, based on a predetermined condition of whether the photographedimage contains an object, a person, or the like (S106). If it is notdetermined that the image is transmitted (S106: NO), then theinformation processing apparatus 10 performs the operation of step S101again. If it is determined that the image is transmitted (S106: YES),then the transmission control unit 106 allows the communication unit 120to transmit the photographed image to the server 20 (S107).

Subsequently, the server 20 performs image recognition on the imagereceived from the information processing apparatus 10 (S108). Then, theserver 20 extracts additional information about the object, person, orthe like recognized from the received image, for example, from a largeamount of reference data stored in a storage unit of the server 20(S109). Then, the server 20 transmits the extracted additionalinformation to the information processing apparatus 10 (S110). Then, thedisplay control unit 108 of the information processing apparatus 10allows the display unit 126 to display the additional informationreceived from the server 20 (S111).

[3-1-3. Advantages]

In the above, as described, for example, with reference to FIGS. 3, 11,and other illustrations, the information processing apparatus 10according to the first embodiment recognizes an action state of the userbased on the measurement results obtained by the measurement unit 122and controls the timing at which the photographing unit 124 is allowedto perform photographing based on the recognized action state. Thus, itis possible to control adaptively the timing of photographing dependingon the action state of the user.

For example, when it is recognized that a user is not moved whileremaining stationary, the information processing apparatus 10 sets thefrequency with which the photographing unit 124 is allowed to performphotographing to be smaller than a frequency to be set when the user ismoving. In general, when a user is stationary, it is assumed that thelandscape at which user is looking has a little change. Thus, an imagewhere it is assumed that the image is undesirable to the user or theimage is not considered important can be significantly prevented frombeing photographed. Accordingly, the power consumed by photographing canbe reduced.

3-2. Second Embodiment

The first embodiment has been described above. Next, a second embodimentis described. As described later, according to the second embodiment, aninformation processing apparatus 10 can reduce the amount of informationof the image transmitted to the server 20, thereby reducing the powerconsumption.

[3-2-1. Configuration of Information Processing Apparatus 10]

The configuration of the information processing apparatus 10 accordingto the second embodiment is first described in detail. FIG. 12 is afunctional block diagram illustrating the configuration of theinformation processing apparatus 10 according to the second embodiment.As illustrated in FIG. 12, the information processing apparatus 10further includes an image processing unit 110, a face region detectionunit 112, and a blur determination unit 114, as compared with theconfiguration of the first embodiment.

(3-2-1-1. Transmission Control Unit 107)

A transmission control unit 107 according to the second embodimentallows the communication unit 120 to transmit an image processed by animage processing unit 110 described later to the server 20. Morespecifically, the transmission control unit 107 can cause the image,which is generated by the image processing unit 110 and has the reducedamount of information, to be transmitted to the server 20 based on thephotographed image captured by the photographing unit 124.

As described in detail later, for example, the transmission control unit107 causes the image of a particular region clipped from thephotographed image by the image processing unit 110 to be transmitted tothe server 20. Alternatively, the transmission control unit 107 causesthe image obtained by reducing the resolution from the photographedimage by the image processing unit 110 to be transmitted to the server20. Alternatively, the transmission control unit 107 causes an image ofone or more face regions of a person that is clipped from thephotographed image by the image processing unit 110 to be transmitted tothe server 20.

In addition, as a modification, if the blur determination unit 114described later determines that blurring of the photographed image isgreater than or equal to a threshold, then the transmission control unit107 may also cause the photographed image to be not transmitted to theserver 20.

(3-2-1-2. Image Processing Unit 110)

The image processing unit 110 performs a process regarding the amount ofinformation on the image photographed by the photographing unit 124based on an action state of the user that is recognized by the actionrecognition unit 102 during photographing by the photographing unit 124.More specifically, the image processing unit 110 can generate an imageobtained by reducing the amount of information from the photographedimage using a way corresponding to the action state of the user that isrecognized by the action recognition unit 102 during photographing bythe photographing unit 124.

PROCESSING EXAMPLE 1 (Reduction in Resolution)

For example, when the action recognition unit 102 recognizes that, forexample, a user looks around, downward, or upward when duringphotographing, the image processing unit 110 generates an image obtainedby compressing resolution from the photographed image. Referring to FIG.13, a description of how it functions is given in more detail. FIG. 13is a diagram for describing a generation example in which an image withcompressed resolution (processed image 50) is generated from thephotographed image (photographed image 30). As illustrated in FIG. 13,for example, the image processing unit 110 generates the processed image50 that is an image with the compressed resolution of 320×240 from thephotographed image 30 with resolution of 640×480.

In general, when a user looks around, downward, or upward, it is assumedthat the user looks at a region of wider angle than usual. According toprocessing example 1, by compressing the resolution of the photographedimage, it is possible to reduce the amount of information of the imagewithout reducing the photographing range in which the user is intendedto perform photographing.

PROCESSING EXAMPLE 2 (Clipping of Particular Region)

In addition, as processing example 2, when the action recognition unit102 recognizes that a user is watching during photographing, the imageprocessing unit 110 can generate an image obtained by clipping apredetermined region from the photographed image. Referring to FIG. 14,a description of how it functions is given in more detail. FIG. 14 is adiagram for describing a generation example of generating an image(processed image 50) obtained by clipping a predetermined region in thephotographed image 30 from the photographed image (photographed image30). As illustrated in FIG. 14, for example, the image processing unit110 generates the processed image 50 that is an image obtained byclipping a region with the resolution of 320×240 that is a centralportion of the photographed image 30 from the photographed image 30 withthe resolution of 640×480. The size of the predetermined region may beset, for example, in accordance with the maximum bit width of thecommunication line for transmission to the server 20.

PROCESSING EXAMPLE 2a (Clipping of Particular Region in Walking)

In addition, when the action recognition unit 102 recognizes that a useris moving during photographing, the image processing unit 110 can alsogenerate an image obtained by clipping a predetermined region from thephotographed image. Referring to FIGS. 15 to 18, a description of how itfunctions is given in more detail. FIG. 15 is a diagram for describing astate in which a user is stationary while looking forward. FIG. 15illustrates a visible area 32 at which the user is looking as a planview for simplicity of description.

In addition, FIG. 16 is a diagram for describing a state in which a useris walking while looking forward. In general, the field of view of theuser when walking is smaller than that when the user is stationary, andthus the user tends to look at a region 52 smaller than the visibleregion 32 of the user when stationary, as illustrated in FIG. 16. Thus,when it is recognized that the user is walking while looking forwardduring photographing, for example, the image processing unit 110 maygenerate an image that is obtained by clipping a region within apredetermined distance from the center in the photographed image asillustrated in FIG. 17. FIG. 17 illustrates a generation example of animage (processed image 50) obtained by clipping a region within thedistance d1 from the center in the photographed image (photographedimage 30). According to this generation example, an image of an object,a person, or the like that is watched by the user during photographingcan be clipped appropriately, and the amount of information of an imagecan be reduced.

Alternatively, in such a case, the image processing unit 110 maygenerate an image that is obtained by clipping a peripheral region at apredetermined distance or more away from the center in the photographedimage as illustrated in FIG. 18. FIG. 18 illustrates a generationexample of the image (processed image 50) that is obtained by clipping aperipheral region at the distance d1 or more away from the center in thephotographed image (photographed image 30).

According to this generation example, it is possible to extract an imageof an object, a person, or the like that is not watched by the userduring photographing. Thus, when the clipped image is transmitted to theserver 20 and additional information regarding the clipped image isreceived from the server 20, it is advantageously possible for the userto know information regarding an object or a person that is not noticedor is little considered by the user during photographing.

PROCESSING EXAMPLE 2b (Clipping of Particular Region in Looking Down)

In addition, when the action recognition unit 102 recognizes that a useris looking down during photographing, the image processing unit 110 canclip a region from the photographed image such that the region to beclipped is within a predetermined distance from the lower end of thephotographed image. Referring to FIGS. 19 and 20, a description of howit functions is given in more detail. FIG. 19 is a diagram fordescribing a state in which a user looks downward and is stationary. Asillustrated in FIG. 19, in general, when a user tilts his head to lookdown, for example, the user casts his eyes downward, and thus the usertends to look at a region 52 in the lower side than the visible region32 when the eyes look forward.

Thus, when the action recognition unit 102 recognizes that a user looksdown during photographing, the image processing unit 110 may generate animage (processed image 50) that is obtained by clipping a region fromthe photographed image (photographed image 30) such that the region tobe clipped is within the distance d2 from the lower end of thephotographed image as illustrated in FIG. 20. The value of the distanced2 can be set as an appropriate fixed value, for example, by performinga user test in advance.

PROCESSING EXAMPLE 2c (Clipping of Particular Region in Looking Upward)

In addition, when the action recognition unit 102 recognizes that a userlooks upward during photographing, the image processing unit 110 canclip a region from the photographed image such that the region to beclipped is within a predetermined distance from the upper end of thephotographed image. Referring to FIG. 21, a description of how itfunctions is given in more detail. In general, when a user tilts hishead to look upward, the user casts his eyes upward as opposed to whenthe user looks down, and thus the user tends to look at a region in theupper side than when the eyes look forward.

Thus, when the action recognition unit 102 recognizes that a user looksupward during photographing, the image processing unit 110 may generatean image (processed image 50) that is obtained by clipping a region fromthe photographed image (photographed image 30) such that the region tobe clipped is within the distance d2 from the upper end of thephotographed image 30 as illustrated in FIG. 21.

PROCESSING EXAMPLE 3 (Clipping of Face Region of Person)

In addition, as processing example 3, as illustrated in FIG. 22 or 23,when a face region detection unit 112 described later detects a faceregion of a person contained in the photographed image, the imageprocessing unit 110 can generate an image obtained by clipping thedetected face region from the photographed image. As illustrated in FIG.22, when the face region detection unit 112 detects the entire region ofthe face of a person, the image processing unit 110 may generate animage obtained by clipping the detected entire region of the face fromthe photographed image. In addition, as illustrated in FIG. 23, when theface region detection unit 112 detects a partial region of the face of aperson, the image processing unit 110 may generate an image obtained byclipping only the detected partial region of the face from thephotographed image.

PROCESSING EXAMPLE 4 (Correction of Blur)

In addition, as a modification, if the blur determination unit 114described later determines that the photographed image is blurred to begreater than or equal to a threshold, then the image processing unit 110can also correct a blur contained in the photographed image based on theaction state of the user recognized by the action recognition unit 102during photographing. For example, when the action recognition unit 102recognizes that a user is in walking state during photographing, theimage processing unit 110 may correct the photographed image using aprogram, which is previously stored in the storage device 162, for blurcorrection corresponding to a walking state. In addition, when featuresof each action of the user are known previously, for example, by theinformation processing apparatus 10, the image processing unit 110 maycorrect the photographed image using a program, which is previouslystored in the storage device 162, for blur correction corresponding tofeatures of each action of the user.

In addition, the image processing unit 110 may correct a blur containedin the photographed image depending on the amount of change in movementor the amount of change in angle in three-dimensional space of theinformation processing apparatus 10, which is measured by themeasurement unit 122 during photographing.

(3-2-1-3. Face Region Detection Unit 112)

The face region detection unit 112 is able to detect a face region of aperson contained in the photographed image. For example, the face regiondetection unit 112 detects a face region of a person by extractingfeature points such as eye, nose, or facial contour in the photographedimage.

(3-2-1-4. Blur Determination Unit 114)

The blur determination unit 114 determines whether the photographedimage is blurred to be greater than or equal to a threshold. Forexample, the blur determination unit 114 determines whether thephotographed image is blurred to be greater than or equal to a thresholddepending on the magnitude of the angle fluctuations measured by thegyroscope 172 during photographing. The threshold may be a value that isset by, for example, a designer or user of the information processingapparatus 10.

The functions of other components are similar to those of the firstembodiment, and thus the description thereof is omitted here.

[3-2-2. Operation]

The configuration according to the second embodiment has been describedabove. Next, the operation according to the second embodiment isdescribed.

FIG. 24 is a sequence diagram illustrating the operation according tothe second embodiment. The operations of steps S201 to S205 are similarto those according to the first embodiment illustrated in FIG. 11, andthus the description thereof is omitted.

After step S205, the transmission control unit 107 determines whetherthe image photographed in S205 is transmitted to the server 20 (S206).For example, if the blur determination unit 114 determines that thephotographed image is blurred to be greater than or equal to athreshold, then the transmission control unit 107 determines that thephotographed image is not transmitted to the server 20 (S206: NO). Onthe other hand, if the blur determination unit 114 determines that thephotographed image is blurred to be less than a threshold, then thetransmission control unit 107 determines that the photographed image istransmitted to the server 20 (S206: YES).

Then, if it is determined that the photographed image is not transmittedto the server 20 (S206: NO), the information processing apparatus 10performs the operation of S201 again. On the other hand, if it isdetermined that the photographed image is transmitted to the server 20(S206: YES), then the image processing unit 110 generates an image thatis obtained by reducing the amount of information from the photographedimage using a way corresponding to the action state of the user that isrecognized by the action recognition unit 102 during photographing bythe photographing unit 124 (S207). For example, if the face regiondetection unit 112 detects a face region of a person in the photographedimage, then the image processing unit 110 generates an image, which isobtained by clipping the detected face region, from the photographedimage.

Subsequently, the transmission control unit 107 allows the communicationunit 120 to transmit the image generated or processed in step S207 tothe server 20 (S208). The operations subsequent to step S208 aresubstantially similar to those of steps S108 to 111 of the firstembodiment illustrated in FIG. 11, and thus a description thereof isomitted.

[3-2-3. Advantages]

In the above, as described, for example, with reference to FIGS. 12, 24,and other illustrations, the information processing apparatus 10according to the second embodiment recognizes an action state of theuser based on the measurement results obtained by the measurement unit122. Then, the information processing apparatus 10 perform the processregarding the amount of information on the image photographed by thephotographing unit 124 based on the action state of the user recognizedduring photographing by the photographing unit 124. Then, theinformation processing apparatus 10 causes the processed image to betransmitted to the server 20. Thus, information processing apparatus 10can reduce adaptively the communication traffic in transmitting theprocessed image to the server 20.

For example, when the information processing apparatus 10 recognizes anaction in which a user is looking around during photographing, theinformation processing apparatus 10 compresses the resolution of thephotographed image and transmits the image having compressed resolutionto the server 20. Alternatively, when the information processingapparatus 10 recognizes an action in which a user is watching duringphotographing, the information processing apparatus 10 clips the regionthat is estimated as being watched by the user and transmits the clippedregion to the server 20. Thus, it is possible to reduce the amount ofinformation using an appropriate way depending on the action state ofthe user during photographing, thereby reducing adaptively thecommunication traffic.

In addition, if the photographed image is blurred to be greater than orequal to a threshold, then the information processing apparatus 10 maybe unable to transmit the image to the server 20. In this way, theinformation processing apparatus 10 does not transmit an image, which isdifficult to perform appropriate image recognition by the server 20, tothe server 20, thereby reducing the communication traffic moreefficiently. Furthermore, basically, the information processingapparatus 10 performs only detection processing on whether thephotographed image contains a face region of a person, and if a faceregion is detected, then the information processing apparatus 10transmits an image of the detected face region to the server 20. Theinformation processing apparatus 10 allows the server 20 to specify aperson corresponding to the detected face region and receives thespecified result from the server 20. Thus, the information processingapparatus 10 can reduce the amount of calculation necessary to specify aperson contained in the photographed image, resulting in reduced powerconsumption.

<<3. Modification>>

The preferred embodiments of the present disclosure have been describedabove with reference to the accompanying drawings, whilst the presentdisclosure is not limited to the above examples, of course. A personskilled in the art may find various alterations and modifications withinthe scope of the appended claims, and it should be understood that theywill naturally come under the technical scope of the present disclosure.For example, the information processing apparatus 10 according to eachembodiment is not limited to a device provided with a glasses-typedisplay as illustrated in FIG. 1. The information processing apparatus10 may be configured as a wristwatch type device, a device that is wornon the user's neck such as a neck strap, a device that is mounted on theclothing of the user such as a wearable badge, or a device that isattached to the body of the user such as a headphone.

Furthermore, in the above, there has been described the example in whichthe information processing apparatus 10 is configured to include, forexample, all of various types of sensors such as the positioninformation measuring device 168 and the acceleration sensor 170, but anembodiment of the present disclosure is not limited thereto. Any one ormore of the position information measuring device 168, the accelerationsensor 170, the gyroscope 172, and the microphone 174 may be provided inother portable devices that a user can carry. For example, when theacceleration sensor 170 is provided in another device that is attachednear of the user's waist, the acceleration when the user is walking canadvantageously be measured more accurately.

Moreover, according to one or more embodiments of the presentdisclosure, it is possible to provide a computer program used to allowhardware such as the CPU 150, the ROM 152, and the RAM 154 to execute afunction equivalent to that of each component in the informationprocessing apparatus 10 described above. In addition, a storage mediumfor storing the computer program is also provided.

Additionally, the present technology may also be configured as below:

-   (1) An information processing apparatus including:

an action recognition unit configured to recognize an action state of auser based on a measurement result obtained by a sensor carried by theuser; and

a photographing control unit configured to control timing at which aphotographing unit carried by the user is allowed to performphotographing based on the recognized action state of the user.

-   (2) The information processing apparatus according to (1),

wherein the action state of the user includes a movement state of theuser, and

wherein the photographing control unit changes the timing at which thephotographing unit is allowed to perform photographing based on whetherthe user is moving.

-   (3) The information processing apparatus according to (2), wherein    the photographing control unit sets a frequency with which the    photographing unit is allowed to perform photographing when the user    is stationary to be smaller than a frequency to be set when the user    is moving.-   (4) The information processing apparatus according to (3), wherein    the photographing control unit allows the photographing unit to    perform photographing at a predetermined time interval when the user    is moving.-   (5) The information processing apparatus according to any one of (1)    to (4),

wherein the action state of the user includes a vision-related state ofthe user, and

wherein the photographing control unit changes the timing at which thephotographing unit is allowed to perform photographing based on avision-related state of the user recognized by the action recognitionunit.

-   (6) The information processing apparatus according to (5), wherein    the photographing control unit allows the photographing unit to    perform photographing when the action recognition unit recognizes    that the user is watching.-   (7) The information processing apparatus according to (5) or (6),    wherein the action recognition unit recognizes the vision-related    state of the user based on a movement of a head of the user measured    by the sensor.-   (8) The information processing apparatus according to (7), wherein    the action recognition unit recognizes that the user is watching    when the sensor measures that a speed of the movement of the user's    head is reduced to be less than or equal to a predetermined value.-   (9) The information processing apparatus according to any one of (1)    to (8),

wherein the action state of the user includes an voice-related state ofthe user, and

wherein the photographing control unit allows the photographing unit toperform photographing when the action recognition unit recognizes thatthe user speaks.

-   (10) The information processing apparatus according to any one    of (1) to (9), wherein the sensor measures information including    acceleration, an angle, or a voice.-   (11) The information processing apparatus according to any one    of (1) to (10), wherein the information processing apparatus further    include the photographing unit.-   (12) An information processing method including:

recognizing an action state of a user based on a measurement resultobtained by a sensor carried by the user; and

controlling, by a processor, timing at which a photographing unitcarried by the user is allowed to perform photographing based on therecognized action state of the user.

-   (13) A program for causing a computer to function as:

an action recognition unit configured to recognize an action state of auser based on a measurement result obtained by a sensor carried by theuser; and

a photographing control unit configured to control timing at which aphotographing unit carried by the user is allowed to performphotographing based on the recognized action state of the user.

What is claimed is:
 1. An information processing apparatus, comprising:a central processing unit (CPU) configured to: recognize an action stateof a user based on a measurement result obtained by a sensor carried bythe user; set, based on the recognition that the recognized action stateis a stationary state, a first frequency with which a photographing unitcarried by the user is allowed to perform photographing to be smallerthan a second frequency with which the photographing unit is allowed toperform the photographing based on the recognized action state being amoving state, wherein a first power consumption of the informationprocessing apparatus in the stationary state is lesser than a secondpower consumption of the information processing apparatus in the movingstate; and send view data to an image processing apparatus, wherein theview data is photographed by the photographing unit with one of thefirst frequency or the second frequency.
 2. The information processingapparatus according to claim 1, wherein the CPU is further configured tocontrol the photographing unit to perform the photographing at adetermined time interval based on the user being in motion.
 3. Theinformation processing apparatus according to claim 1, wherein theaction state of the user includes a vision-related state of the user,and wherein the CPU is further configured to change the timing at whichthe photographing unit is allowed to perform the photographing based onthe vision-related state of the user.
 4. The information processingapparatus according to claim 3, wherein the CPU is further configured tocontrol the photographing unit to perform the photographing based on adetermination that the user is watching an object.
 5. The informationprocessing apparatus according to claim 3, wherein the CPU is furtherconfigured to determine the vision-related state of the user based on amovement of a head of the user measured by the sensor.
 6. Theinformation processing apparatus according to claim 5, wherein the CPUis further configured to determine that the user is watching an objectbased on a measurement by the sensor that a speed of the movement of thehead of the user is less than or equal to a determined value.
 7. Theinformation processing apparatus according to claim 1, wherein theaction state of the user includes an voice-related state of the user,and wherein the CPU is further configured to control the photographingunit to perform the photographing based on the voice-related state ofthe user.
 8. The information processing apparatus according to claim 1,wherein the sensor is configured to measure information including one ormore of an acceleration of the information processing apparatus, anangle of the information processing apparatus, or a voice of the user.9. An information processing method, comprising: recognizing an actionstate of a user based on a measurement result obtained by a sensorcarried by the user; and setting, based on the recognition that therecognized action state is a stationary state, a first frequency withwhich a photographing unit carried by the user is allowed to performphotographing to be smaller than a second frequency with which thephotographing unit is allowed to perform the photographing based on therecognized action state being a moving state, wherein a first powerconsumption of the information processing apparatus in the stationarystate is lesser than a second power consumption of the informationprocessing apparatus in the moving state; and sending view data to animage processing apparatus, wherein the view data is photographed by thephotographing unit with one of the first frequency or the secondfrequency.
 10. A non-transitory computer-readable medium having storedthereon, computer-executable instructions which when executed by aninformation processing apparatus cause the information processingapparatus to execute operations, the operations comprising: recognizingan action state of a user based on a measurement result obtained by asensor carried by the user; and setting, based on the recognition thatthe recognized action state is a stationary state, a first frequencywith which a photographing unit carried by the user which is allowed toperform photographing to be smaller than a second frequency with whichthe photographing unit is allowed to perform the photographing based onthe recognized action state being a moving state, wherein a first powerconsumption of the information processing apparatus in the stationarystate is lesser than a second power consumption of the informationprocessing apparatus in the moving state; and sending view data to animage processing apparatus, wherein the view data is photographed by thephotographing unit with one of the first frequency or the secondfrequency.
 11. The information processing apparatus according to claim1, further comprising: a transceiver configured to transmit the viewdata photographed by the photographing unit to the image processingapparatus.
 12. The information processing apparatus according to claim11, wherein the image processing apparatus is a network server connectedto the transceiver.